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IMAGE PROCESSING FOR IMAGE CORRECTION 



This application is based on application No. 11- 
1804 60 filed in Japan, the contents of which are hereby 
5 incorporated by reference. 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 
; J3 The present invention relates to image correction 

m. 

:£} 10 of color image. 

■ O 

ifl 

; g DESCRIPTION OF PRIOR ART 

! 3 As to digital image data, especially color digital 

: z f 

\%i image data, various types of . correction are- performed on 

i =1 . _ 

;5j 15 input image data. It is known that after digital image data 



are analyzed, the analysis result is presented in a user 
interface and that parameters for image processing are 
inputted by a user. For example, in an image processing 
described in Japanese Patent laid open Publication 10- 
20 233934/1998, color attributes (value, chroma and hue) of a 
color in an object image are analyzed, and they are adjusted 
in an interactive way. For example, value information is 
analyzed, and the analysis result is displayed as a 
histogram of value. Then, an operator instructs to increase 
or decrease the value by referring to the graphic 



25 
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presentation. Then, image correction is performed by using 
the instructed parameters- For example, the histogram is 
expanded to adjust the image according to the analysis 
results . 

However, for a general user, it is difficult to 
set parameters of color attributes for image correction or 
to correct the parameters when an unsatisfactory correction 
result is obtained. For example, for an image having color 



; fl fog, it is difficult to set parameters in correspondence to 

=D 10 the color fog. Therefore, it is favorable to easily reflect 

=0 

!Jt; user's wish in image correction. 

It 

Q. SUMMARY OF THE INVENTION 

m 

m An object of the present invention is to allow a 

! =*■ 

: r -~f 

q 15 user correct image data easily according to results of image 
~ analysis. 

In one aspect of the invention, in the image 
processing, a controller analyzes image data to determine a 
characteristic thereof, and corrects the image data with the 

20 first correction parameter, and a display device displays 
the characteristic of the image data and a first correction 
parameter in correspondence to the characteristic in a 
screen. A user can instruct with an instruction device to 
set a second correction parameter in the screen. The 

25 controller corrects the image data with the second 
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correction parameter when the user sets the second 
correction parameter. 

In another aspect of the invention, in the image 
processing, a controller analyzes image data to determine a 
5 characteristic thereof and corrects the image data 
automatically with a correction parameter in correspondence 
to the characteristic of the image data. A display device 
displays the characteristic of the image data obtained by 
; fl the controller in a screen after the image data is corrected 

m 

: A 10 by the controller. If a user is not satisfied with the 

: S 

!Jr result, a user can change the image correction with 

iO; 

iH reference to the characteristic of the image presented in 

O the screen. 

!1J An advantage of the present invention is that 

: t 

]==j 15 automatic image correction becomes more successful. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and features of the 
present invention will become clear from the following 
20 description taken in conjunction with the preferred 
embodiments thereof with reference to the accompanying 
drawings, and in which: 

Fig. 1 is a diagram of an entire image processor; 
Fig. 2 is a block diagram of a controller and 
25 thereabout; 
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Fig. 3 is a main flowchart in a first embodiment 
of the invention; 

Fig. 4 is a flowchart of changing a graphic user 
interface while displaying image analysis results; 

Fig. 5 is a flowchart of parameter setting; 

Fig. 6 is a diagram of window presentation for 
setting parameters; 

Fig. 7 is a flowchart of default operation; 

Fig. 8 is a diagram of window presentation for 
setting operation on color fog correction; 

Fig. 9 is a main flowchart in a second embodiment 
of the invention; 

Fig. 10 is a diagram of a window presentation when 
a backlight image is decided as a normal image and corrected 
automatically; 

Fig. 11 is a diagram of an example of window 
presentation for setting parameters; and 

Fig. 12 is a diagram of another example of window 
presentation for setting parameters. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring now to the drawings, wherein like 
reference characters designate like or corresponding parts 
throughout the several views, Fig. 1 shows an entire image 
processing apparatus according to a first embodiment of the 
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invention. It has a controller (computer) 1 which controls 
the entire apparatus, as a central component. In Fig. 1, 
arrows show directions of data flow. A display device 2 
displays various screens provided for operation or image 
5 processing as well as an image or characters in a screen. A 
keyboard 3 and a mouse 4 are used for various inputs and 
instructions by a user. A flexible disk 5 and a hard disk 6. 
are storage media for storing, for example, image data, 
attribute information and programs. The apparatus has a 

10 flexible disk drive and a hard disk drive for accessing the 
flexible disk 5 and the hard disk 6. A printer 7 prints 
image data or the like on a paper. A scanner 8 reads image 
data of a document. A CD-ROM 9 is a recording medium for 
storing various data or programs, and the apparatus has a 

15 CD-ROM drive for accessing the CD-ROM 9. Programs explained 
later are read from an external recording medium such as a 
CD-ROM. 

Fig. 2 is a block diagram of the controller 1 and 
thereabout. The controller 1 has a central processing unit 

20 (CPU) 210, and it is connected via a bus 220 to a read-only- 
memory (ROM) 2 03 for storing various data and a random 
access memory (RAM) for storing various data and programs. 
Further, it is also connected via the bus 220 to a display 
controller 205 for displaying images and characters in a 

25 screen of the display apparatus 2, a keyboard controller 206 
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for controlling key- input from the keyboard 3 / a mouse 
controller for controlling an input from the mouse 4, a 
flexible disk controller 208 which controls the flexible 
disk drive, a hard disk controller 2 09 for controlling the 
5 hard disk 6, a printer controller 210 which controls outputs 
to the printer 7, a scanner controller 211 which controls 
the scanner 8, and a CD-ROM drive controller 212 which 
controls the CD-ROM drive. Further, in the controller, a 
!§ clock circuit 202 generates various clock signals for 

: D 10 operating the apparatus. Further, extension slots 215 are 
connected to the bus for connecting various extension boards 
3 to which for example a SCSI board is connected for 

□ connecting ' a flexible disk drive, a hard disk drive, a 

V scanner, a CD-ROM drive or the like. Further, it is also 

li ' 

3 15 connected via an interface card to a network (web) . In this 

3 

apparatus, the flexible disk 5 and the hard disk 6 are used 
as storage media, but other medium such as a magneto-optical 
disk may also be used. The scanner 8 and the CD-ROM 9 are 
used for inputting image data, but another input devise such 

20 as a still video camera may also be used. The printer 7 is 
used as an output device, but a digital copying machine or 
the like may also be used. 

In this apparatus, image data are corrected in an 
image correction routine which includes presentation of 

25 image analysis result.' When start of image correction is 
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instructed by a user, the routine is evoked. The image 
correction routine further includes image file input/output 
processing, image data display processing, a graphic user 
interface processing for image correction operation, error 
processing in the graphic user interface processing, and 
resolution change processing, but they are not explained 
here. The structures of the image processing apparatus 
shown in Figs. 1 and 2 are common in other embodiments which 
will be explained later- 
Presentation of image analysis result in image 
correction is . explained below. In this processing, image 
data is analyzed, and the analysis result thereof is 
displayed in a screen of the display device 2 to inform a 
correction parameter on image correction to a user while 
setting the correction parameter based on the analysis. 

Next, a first embodiment of the invention is 
explained. In this embodiment, image analysis result 
(characteristics of image) is displayed and a user can set a 
different correction parameter on the image. 

Fig. 3 shows a main flowchart of image correction. 
First, image data obtained by the scanner 8 is received and 
stored in a memory (step S10) , and the image data is 
analyzed (step S12) . In the analysis, histograms of R, G, B 
data, value data or the like are prepared, and image data 
are divided into areas . A scene such as color fog, 
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backlight, underexposure, overexposure, night scene or the 
like is decided. Next, the image analysis result is 
displayed in the screen of the display apparatus 2 and the 
graphic user interface (GUI) is changed (step S14, refer to 
5 Fig. 6) . Next, a correction parameter may be inputted by a 
user (step S16) . The correction parameter such as "weak 
color fog" or "backlight" is determined beforehand in 
^ correspondence to the characteristic of the image obtained 

5 by the image analysis. A user observes the image analysis 

D 10 result and the recommended correction parameter in the 
fl; screen and changes the correction parameter if necessary, 

a 

B The "correction parameter" which a user sets or changes is 

□ not a correction parameter on color components, but a 

correction parameter represented in the screen with a 
15 sentence, such as "correct color fog weakly" or "correct 
backlight". The image processor interprets the correction 
parameter as parameters for color processing operation for 
"correct color fog weakly" or "correct backlight", and 
corrects the image with the parameters. Next, image 
20 correction is performed with the input correction parameter 
(step S18). For example, color fog is deleted. 

Fig. 4 shows a flowchart of changing a graphic 
user interface while displaying the image analysis result. 
First, the image analysis result is displayed in the screen 
25 (step S30) . That is, a scene decided as a result of image 



11 
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analysis is displayed. For example, a scene where "weak 
color fog exists" is displayed. Next, a parameter and an 
operation for the scene of the analysis result are set (step 
S32) . As an example of the processing, parameter setting for 
5 color fog correction is explained with reference to Figs. 5 
and 6 . 

Fig. 5 is a flowchart of parameter setting for 
color fog correction (step S32 in Fig. 4) . The flow 
branches according to the analysis result of color fog image 

10 (refer to step S12 in Fig. 3) (step S50) . When weak color 

fog is detected, the correction parameter is set to "correct 
weakly" and it is displayed in the screen (step S52) . When 
strong color fog is detected, the correction parameter is 
set to "correct strongly" and it is displayed in the screen 

15 (step S54). When no color fog is detected, the correction 

parameter is set to "no correction" and it is displayed in 
the screen (step S56) . Next, the image is subjected to 
image correction, and the image after correction is 
displayed in the screBn (step S58) . Thus, a preview image 

20 after correction with the parameter are displayed in the 
screen.. 

Fig. 6 shows an example of a screen (window) in 
the display apparatus 2 for setting the parameter in color 
fog correction. At the lower left side, three color fog 
25 parameters ("No correction", "Correct weakly" and "Correct 
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strongly") are presented. In this example, weak color fog 
is detected. Therefore, a mark in correspondence to 
"Correct weakly" is selected as the parameter, and a 
sentence therefor is displayed at the lower right side. 
5 Further, an image before correction is displayed at the 
upper left side, while an image subjected to weak color fog 
correction (preview image) is displayed at the upper right 
l3 side. By observing the screen, a user can understand the 

image analysis result and the recommended parameter and can 



IT* 



g 10 operate the correction only by clicking "RUN" button. If a 
user does not satisfy the analysis result by observing the 
preview image, he can press "CANCEL" button to change the 
parameter- For example, if the correction is insufficient, 
the value for the insufficient parameter may be changed 



Q 

w 

Q 15 . according to the analysis result 



20 



25 



Fig. 7 is a flowchart of default operation for 
color fog correction (step S32 in Fig. 4) . When color fog 
is detected (YES at step S70), "RUN" button is displayed as 
a default button in the screen (step S72) . On the other 
hand, When color fog is not detected (NO at step S70) , 
"CANCEL" button is displayed as a default button in the 
screen (step S74) . 

Fig. 8 shows an example of a screen (window) in 
the display apparatus 2 for setting default operation on 
color fog correction. In this example, weak color fog is 
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detected/ and "CORRECT" button is recommended as the default 
button. When the correction is performed, a user can 
understand the image analysis result and operate only by 
pressing "ENTER" key. 
5 Next a second embodiment of the invention is 

explained. In this embodiment, the image analysis result 
is explained after the automatic correction. Fig. 9 is a 
main flowchart of this embodiment. First, an image is read 
and stored in a memory (step S100), and it is analyzed (step 
10 S102) . Similarly to the first embodiment, histograms of R, 
G, B data, value data or the like are prepared, and image 
data are divided into areas. Then, a scene such as color 
fog, backlight, underexposure, overexposure, night scene or 
the like is decided. Image correction is performed based on 
image analysis result (step S104) , wherein the parameter is 
adjusted automatically according to the analysis result of 
step S102 and image correction is performed with the 
parameter (step S106) . Next, an image after the correction 
is displayed (step S106) , and the image analysis result is 
also displayed (step S108) . If a user does not satisfy the 
image after correction (NO at s±ep S110), he adjusts the 
parameter based on to the analysis result (step S112), and 
the image is corrected again (step S114) . 

Fig. 10 shows an example of a screen (window) of 
the display apparatus when a backlight image is decided 
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erroneously as a normal image and corrected automatically. 
It is understood from the screen that the image is decided 
as a normal image, and this means that the image is 
corrected with the parameter for normal correction. If this 
5 automatic correction is different from user's intention, the 
user can understand the cause thereof. Therefore, it is 
understood easily how the parameter is set for obtaining the 
intended image. Further, a satisfactory result can be 
; 0 obtained simply by changing the parameter- In this case, a 

m ■ * 

=g 10 user does not satisfy the analysis result because the image 

- ^ 

• JLi 

ij| is an image under backlight. 

. 

IB Then, a user presses the cancel button shown in 

13 Fig. 10, to cancel the correction. Next, the correction 

ly- parameter is changed, and execution of correction is 
:i 15 instructed. By referring to screens (windows) of the 



20 



display apparatus 2 for setting parameters shown in Figs. 11 
and 12, steps in Fig. 10 for changing the correction 
parameter and executing image correction are explained. 
Figs, 11 and 12 show that four types of correction parameter 
of normal, backlight, color fog and night scene can be set. 
Further, Fig, 11 shows that the default value of the 
correction parameter is set to "CORRECT FOR NORMAL IMAGE " 
according to the analysis result. However, a user does not 
satisfy the analysis result and sets "CORRECT FOR BACKLIGHT 
25 IMAGE" as correction parameter and presses "RUN" button to 
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performed desired correction. Fig. 12 shows that "CORRECT 
FOR BACKLIGHT IMAGE" is selected as correction parameter. 

As explained above, the image analysis result is 
displayed in the screen, it helps a user to understand how 
5' to change the correction parameter when a desired image is 
not obtained due to erroneous decision of the scene or the 
like and the correction parameter on the image is changed 
manually. Even a beginner can understand easily what 

O 

! fl parameter has to be set. 

IJt 

0 10 For example, in the above example, it is decided 

•0 

iH that the image has weak color fog, and a button for color 

IB fog deletion is set in an enabled state. Further, there are 

13 three correction parameters of NO, WEAK and STRONG on color 

m 

m fog deletion, and "WEAK" is set in a selected state. 

q 15 As in the example in the second embodiment, when a 

:==j 

, ~~ backlight image is dealt as a normal image, the correction 

parameter .of "CORRECT FOR NORMAL IMAGE " is displayed. Then, 
a user presses the cancel button to clear the correction 
result, and sets the parameter for correction on backlight 
20 image. 

In the above-mentioned embodiments, RGB image is 
processed. However, the above processing is applicable not 
only to RGB image, but also to Bayer image dealt in a 
digital camera. 

25 It is an advantage that correction parameter is 
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displayed besides the image analysis result, a user can 
operate image correction without inputting correction 
parameter. Even a beginner can understand easily what 
correction parameter has to be set. It is helpful to 
5 determine how to change the correction parameter when a 
desired image is not obtained due to erroneous decision of 
scene or the like and correction parameter is corrected 
manually. When a user performs desired correction, it is 
if}. understood what correction parameter is changed- For 

m 

:j3 10 example, when correction is insufficient, an insufficient 

\n parameter is increased relative to the analysis result. 

ifl. 

I g ; Although the present invention has been fully 

ig described in connection with the preferred embodiments 

thereof with reference to the accompanying drawings, it is 
;i: IS to be noted that various changes and modifications are 
apparent to those skilled in the art. Such changes and 
modifications are to be understood as included within the 
scope of the present invention as defined by the appended 
claims unless they depart therefrom. 



